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Abstract 

Let c k,l (n) be the number of compositions (ordered partitions) of the 
integer n whose Ferrers diagram fits inside a k xl rectangle. The purpose of 
this note is to give a simple, algebraic proof of a conjecture of Vatter that 
the sequence c k,l (0), c k ' l (l), . . . , c k,l (kl) is unimodal. The problem of giving 
a combinatorial proof of this fact is discussed, but is still open. 



1 Introduction 

Let N and P denote the nonnegative and positive integers, respectively. A partition 
of n G N is a weakly decreasing sequence A = (Ai, . . . , A r ) of positive integers called 
parts such that ^ \ = n. We write Ahnor|A|=nifA partitions n. We will also 
use the notation A = (n m ™, . . . , l mi ) where rrii is the number of times i appears as 
a part in A. If m, = 1 then the exponent is suppressed and if m ; = then so is the 
base. The Ferrers diagram of A, also denoted A, consists of left-justified rows of 
squares with A, squares in row i. The Ferrers diagram of A = (4, 3, 3, 1) = (4, 3 2 , 1) 
is shown in Figure [TJ 

Partitions can be ordered by letting A < /i if the Ferrers diagram for A is 
contained in the upper left corner of the one for \x. Equivalently, A, < for all 
% where we set Aj = if % is greater than the number of parts of A and similarly 
for jM. The set of partitions under this partial order is called Young's lattice. 
More information about partitions and this lattice can be found in the books of 
Andrews PQ, Sagan [10], or Stanley [15] . 
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Figure 1: Ferrers diagrams for the partition A = (4, 3, 3, 1) and the composition 
«= (3,1,4,1) 



We say that A fits inside a k x I rectangle if A < (l k ). In other words, A has at 
most k parts each of size at most I. Let p k ' l (n) denote the number of such A where 
A h n. A sequence a ,ai, . . . ,a r of nonnegative integers is said to be unimodal if 
there is an index m such that 

ao < o-i < ■ ■ ■ < V > a m+ i > . . . > a r . (1) 

Unimodal sequences arise in many aspects of combinatorics, geometry, and algebra. 
See the survey articles of Stanley [H] and Brenti [3] for details. Our interest is in 
the following well-known theorem. 

Theorem 1.1. Given k, I 6 P the sequence 

p k ' l (0),p k > l (l),...,p k > l (kl) 
is unimodal. □ 

This result was first proved by Sylvester [17] using invariant theory. Since then, 
there have been a number of other proofs. In particular, Stanley [13J derived this 
and much more from the hard Lefschetz Theorem of algebraic geometry. Proctor [9] 
was able to reduce Stanley's proof to pure linear algebra. And finally, Kathy 
O'Hara [8] gave a combinatorial proof of this theorem. 

A composition k ofn, written k \= n, is any sequence k — . . . , k r ) of positive 
integers summing to n. Note that a composition need not be weakly decreasing. 
All of the definitions discussed so far have obvious analogues for compositions 
so we will not bother restating them. For example, the Ferrers diagram of the 
composition (3, 1, 4, 1) is displayed in Figured! Although there is a large literature 
surrounding partitions, composition have only recently aroused interest due to their 
connection with quasi-symmetric functions [HE], the theory of patterns [SI [12], and 
the subword and factor partial orders [21 [7J [11] . 
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Let c k,l (n) be the number of compositions of n fitting inside a k x I rectangle. 
In this note we will give a simple, algebraic proof of the following conjecture of 
Vatter [personal communication]. 

Theorem 1.2. Given k, I G P the sequence 

c k \<d),c k \l),...,c k \kl) 

is unimodal. 

In the next section, we will prove this result by passing to the generating 
function of the sequence. The final section will include some comments and an 
indication about how a combinatorial proof of Vatter's conjecture might go. 

2 Unimodality of the composition sequence 

Let a , di, . . . , a r be a sequence of real numbers and let q be a variable. We consider 
the corresponding generating function f(q) = a + a\q + • • ■ a r q r . By convention, 
we let <ij = if i < or i > r. We will say that f(q) has a given property if the 
sequence itself does. 

We will need the standard q-analogue of n, namely 

[n] = 1 + q + q 2 + ■ ■ ■ + q n ~ l . 

It is well known that the generating function for the sequence p h,l (n), < n < kl, 
is the q-binomial coefficient 

[k + l]\ 
[k]\[l}\ 

where [k]\ = [k][k — l] ■ ■ ■ [1]. So arestatement of Theorem 1 1 . 1 1 is that the g-binomial 
coefficients are unimodal. 

To prove the analogous result about compositions, we will need a lemma. It is 
not true, in general, that the product of two unimodal polynomials is unimodal. 
For example, if f(q) = 1 + q + q 2 + 2.3g 3 + 2g 4 then 

/(g) 2 = 1 + 2q + 3q 2 + 6.6g 3 + 9.6g 4 + 8.6g 5 + 9.29g 6 + 9.2g 7 + 4g 8 . 

But we do have the following more specialized result. 

Lemma 2.1. Let f(q) be a unimodal polynomial and let I G P. Then [l]f(q) is 
also unimodal. 



k + l 
I 
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Proof. The lemma is clearly true if I = 1, so assume I > 2. Suppose that 
f(q) is the generating function for the sequence ([I]). Also let [l]f(q) = 2~2 n b n <l n - It 
follows immediately from the definitions that 

bo < h < . . . < b m and 6 m+ /_i > b m+i > . . . > & r+ J-i- 

So the only way that [l]f(q) could fail to be unimodal is if > < b i+ i for some 
i, m < i < m+ 1 — 1. We will show that the case i = m + 1 leads to a contradiction 
as the other cases are similar. 

Suppose b m > b m+ i and b m+ i < b m+2 . Expressing each 6j in terms of the aj 
and then cancelling terms gives a m _z+i > a m +i and a m _i +2 < a m+2 . Using these 
inequalities and (CQ), we have 

But this is a contradiction to ([1]) since / > 2. □ 
Now let 

/*■' = /*•'((/) = X)c*''(n)9 B - 

n>0 

Our main result is as follows. 
Theorem 2.2. Le£ fc, Z G P. 

(a) Ifk>2 then 

/*.' = 1 + 
C6 j T/ie polynomial f k)l is unimodal. 

Proof, (a) Let K k ' 1 be the set of compositions fitting inside a k x / rectangle, 
and let K k,l (r) C be those compositions with first part equal to r. So we have 
the disjoint union 




where e denotes the empty composition. Removing the first part of any k G K k,t 
leaves a composition in K k ~ 1,1 . So translating the union above into a generating 
function gives the desired result. 

(b) We induct on k. Clearly f 1 ' 1 = [I + 1], so we are done in the base case. If 
k > 2 then using part (a) and the lemma finishes the proof. □ 
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3 Comments and open questions 



3.1 Log concavity and symmetry 

A sequence do, a\, . . . ,a r is log concave if a] > a^ia^i for all i with < i < r. 
The following easily proved and well-known proposition gives a connection between 
log-concavity and unimodality. 

Proposition 3.1. Let a , a\, . . . , a r be a sequence of positive real numbers. If the 
sequence is log concave, then it is also unimodal. □ 

Sometimes to prove a sequence is unimodal, it is actually easier to prove that it 
satisfies the stronger log-concavity condition. This is because proving unimodality 
directly may involve finding the index where the sequence is maximized, and that 
can be highly nontrivial. However, the sequence p k,l (n), < n < kl, is not 
log concave in general. So it should come as no surprise that neither is c h ' l (n), 
< n < kl, and for much the same reason. In particular, if k, I > 2 then both 
sequences start 1, 1, 2 which already violates log concavity. 

Another common property of sequences is symmetry. Say that a , a\, . . . , a r is 
symmetric if = a r _j for all i, < % < r. By taking complements in the rectangle, 
it is easy to see that p k,l (n), < n < kl, is symmetric. In general, this property 
is not shared by compositions in a rectangle. For example, if k = I = 2 then the 
corresponding sequence is 1, 1, 2, 2, 1. 

3.2 Lower order ideals 

Let (P, <) be a poset (partially ordered set). Definitions for terms from the theory 
of posets which are not given here can be found in Stanley's book [T3], Chapter 
3]. A lower order ideal is L C P such that x G L and y < x implies y G L. The 
principal lower order ideal generated by x is the order ideal 

L(x) = {y G P | y < x}. 

Let Y and K denote Young's lattice and the poset of all compositions, respectively. 
Then the set of partitions in a rectangle is the order ideal Y(l k ) and similarly for 
compositions. 

If x, y G P then x is covered by y, written x < y, if x < y and there is no 
z with x < z < y. An x^y chain of length n in P is a subposet of the form 
x = Xq < X\ < . . . < x n = y. This chain is saturated if each inequality is actually 
a cover. A poset is graded if it has a unique minimal element denoted 0, a unique 
maximal element denoted 1, and every saturated 0-1 chain has the same length. 
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If P is graded and x E P then all 6—x chains have the same length, called the rank 
of x and denoted rkx. In this case, the nth rank of P is the subposet 

P n = {x G P | rkx = n}. 

We will say that a graded poset P has a property if the sequence of cardinalities 

l-fol) I-Pll) • • • > \Pr\ (3) 

has that property, where r = rkl. We will sometimes preface the property by 
"rank-" if clarification is needed. So Theorem 11.11 can be restated as saying that 
the poset Y(l k ) is unimodal. It is natural to ask whether Y(X) is unimodal for all 
partitions A. But this is too much to ask for, as demonstrated by the following 
theorem of Stanton [16] . 

Theorem 3.2 (Stanton). The lower order ideal Y (8, 8, 4, 4) is not unimodal. □ 

In view of Stanton's result, it is perhaps surprising that all principal lower order 
ideals in the composition poset K are unimodal. Given a graded poset P, we let 
f P — f P (o) be the generating polynomial for the sequence ([3]). The proof of the 
following theorem is so much like that of Theorem 12.21 that we omit it. 

Theorem 3.3. Consider a composition k e K . 

(a) Suppose k = (ki, . . . , k s ) ^ e, letting I = Ki and 7 = (k 2 , . . . , k s ). Then 

fK(K) = l + g p]/*-(7). 

(b ) The polynomial f K ^ is unimodal. □ 
3.3 A combinatorial proof? 

Theorem 12.21 is so easy to prove algebraically, one would think that there is also 
an easy combinatorial proof. But so far one has not been found. Here we present 
a possible inductive approach in the hopes that someone else may be able to push 
it through. 

Let P be poset. A chain decomposition of P is a family of saturated chains 
C±, . . . , C a such that P = tfcJjCj. If P is graded then we say an x-y chain in P 
symmetric if iky = rk 1 — rkx. A symmetric chain decomposition or SCD is a 
chain decomposition where all the chains are symmetric. It is easy to see that if 
P has an SCD then its rank sequence is symmetric and unimodal. 

O'Hara [S] constructed her ground-breaking combinatorial proof ofTheorem ll.il 
as follows. Let Z(X) be the poset of all partitions in Y(X) ordered by fi < v if and 
only if |/i| < \v\. So for any partition A, Z(X) has the same set of ranks as does 
Y(X), but many more covering relations in general. 
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Theorem 3.4 (O'Hara). Given k, I e P, the poset Z{l k ) has an SCD. □ 

We note that it is still an open problem to give an SCD for Y(l k ). 

As mentioned above, K(l k ) is not always rank-symmetric. But we can replace 
symmetry by another condition. If P is graded then we say that a chain decompo- 
sition is modal (an MCD) if there is some rank P m such that every G\ contains an 
element of P m . We call P m the modal rank. The proof of the following proposition 
is similar to the symmetric case, but we include it for completeness. 

Proposition 3.5. Let P be a graded poset. If P has an MCD then P is rank- 
unimodal. 

Proof. Let Ci, . . . , C a be an MCD and let P m be its modal rank. We will 
show that | Pi | < |.Pi+i| for % < m as the inequalities |P,| > |Pj+i| for i > m are 
similar. Let Pi = {xi, . . . , x s } and, since we have a cover, we can assume that Cj 
contains Xj for 1 < j < s. But each Cj is saturated and goes through rank P m . So 
for 1 < j ' < s, Cj must contain an element i/j in rank Pj+i. By disjointness, the yj 
are distinct and thus |p| < |P+i| as desired. □ 

We now ask the obvious questions. 

Question 3.6. Does K(l k ) have an MCD for all k,l £ P? More generally, does 
K(k) have an MCD for all compositions k? 

Note that the modal rank P m for P = K(l k ) seems to occur when 

m = \k(l + l)/2] - 1 

where [•] is the ceiling function. Also note that there are other partial orders on 
the set of compositions [21 13 [EE] and they have the same set of ranks as K{l k ) 
(but not for a general K(k)). Of these, the partial order we are considering has 
the fewest covers. So in may be useful to consider one of the other orders instead. 

It might be hoped that one could come up with an inductive description of 
an MCD for K{l k ) analogous to the inductive proof given of Theorem 12.21 One 
possible way to do this is as follows. For simplicity, we will restrict ourselves to 
the case / = 2. Suppose we have an MCD C±, . . . , C a for K{2 k ~ l ). Then using (T5]) 
we can obtain a chain decomposition 

K(2 k ) = {e}tt{C[,...,C' a }U{Cl...,C':} 

where C[ is gotten by prefixing every element of C{ by a one, and C" is obtained 
similarly using a two prefix. 

Of course, this may be too many chains as not all of them will go through 
rank |~3fc/2] — 1. In particular, some of the C[ may be too "low" and some of the 
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C" too "high." (Also, e must be tacked onto some chain, but just use whichever 
C[ contains the composition (1).) To rectify this, note that if k' and k" are the 
top elements of C[ and C" , respectively, then by construction k' < k". So we can 
replace the pair C[, C" by the pair D[, D" where 

D'^C'^W'} and L>f = Cf -{«/'}. 

Note that this may result in D" = in which case we throw away the chain. Un- 
fortunately, even with this correction the construction breaks down when k = 9 as 
some of the chains do not go through the largest rank. So some other modification 
will be needed to obtain an MCD. 

Acknowledgement. I would like to thank Adam Goyt and Vince Vatter for 
interesting discussions. 
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